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Abstract. 

We investigate the value function of the Bolza problem of the Calculus of Variations 

V(t, x) = inf { jf* L(y(s),y'(s))ds + <p(y{t)) : y G W^(0, t; R n ), y(0) = x| , 

with a lower semicontinuous Lagrangian L and a final cost <p, and show that it is 
locally Lipschitz for t > whenever L is locally bounded. It also satisfies Hamilton- 
Jacobi inequalities in a generalized sense. 

When the Lagrangian is continuous, then the value function is the unique lower 
semicontinuous solution to the corresponding Hamilton-Jacobi equation, while for 
discontinuous Lagrangian we characterize the value function by using the so called 
contingent inequalities. 

Key words. Discontinuous Lagrangians, Hamilton-Jacobi equations, viability the- 
ory, viscosity solutions. 
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1 Introduction 

Consider the autonomous Bolza minimization problem of the Calculus of Variations 

(1.1) inf L(y(s),y'(s))ds + <p(y(T)); y G W^fO, T; R n ), y(0) = x j , 
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where (p: R n i— > J?+ U {+00} and L: R n x R n 1— » J? + are lower semicontinuous and 
L(x, •) is convex. The classical Lagrange problem (with the fixed final condition 
y(T) = xt) may be reduced to the above one by simply setting ^>{xt) = and 
<p = +00 elsewhere. Lagrange problems were studied in the literature from various 
points of view. If a Tonelli type coercivity assumption holds true 

(1.2) 30:R n ^R + , lim = +00, V(x,u), L(x, u) > Q(u), 

u|^oo \u\ 

then absolutely continuous minimizers do exist (see, for instance, |l3|, Cesari]). Ac- 
tually the very same condition yields also lower semicontinuity of the value function 
associated to problem (1.1). It was observed in Ambrosio, Ascenzi and Buttazzo] 
that, without additional (boundedness) assumptions, minimizers are in general not 
Lipschitz. This creates a major difficulty in developing the Hamilton-Jacobi theory 
in a general case. It was also shown in ||] that minimizers are Lipschitz continuous, 
under the local boundedness condition 

V R > 0, 3 M > 0, 3 r > 0, V (x, u) 6 B(0, R) x B(0, r), L(x, u) < M, 

where B{x, r) denotes the closed ball with centre x and radius r. The above condition 
may be rewritten in the following equivalent way: 

(1.3) Vx G R n , 3 M > 0, 3 r > 0, V (x,u) £ B(xQ,r) x B(0,r), L(x, u) < M. 

Since any minimizer of problem ( |1.1[) solves also an associated Lagrange problem, 
the same statement remains valid also for the Bolza problem, whenever the infimum 
m (0) is finite. 

Consider the Hamilton-Jacobi equation 



(1.4) 



V t + H(x, -V x ) = in R* + x R n , 

V(0, -)=<p in R n , 

where R* + = -R+\{0} and H is the Hamiltonian associated with L, defined by 
(1.5) H(x,p)= sup ((p,u) - L(x,u)) , 

i.e., H(x, •) is the Legendre-Fenchel transform of L(x, ■). 

It is a well known fact that (1.4) does not have smooth solutions even when 
H and <p are smooth, and one has to use generalized solutions to treat first order 
equations of the above type. To prove the uniqueness of the solution to (|1.4p in the 
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viscosity sense (as done in [15, Crandall and Lions]), the authors assumed, among 
other hypotheses, the continuity of H and looked for bounded uniformly continuous 
solutions (in the viscosity sense). 

The link between flO] ) and (|TTT|) is the value function V: R + xR n i-> R + U{+oo}, 
defined by 

V(t,x) =mfy\(y(s),y'( S ))d S + ip(y(t)) : y G W 1 ' 1 (0,i;JR n ) J y(0) = 

which is, under some regularity assumptions, a viscosity solution to (|1.4|), i.e., it is a 
supersolution (resp. subsolution) with derivatives replaced by subdifferentials (resp. 
superdifferentials). The above definition of value function is somewhat different 
from the usual one, but, our problem being autonomous, we have found it more 
convenient for our purposes. The reader accustomed to different definitions can 
easily make suitable changes to derive similar results for other value functions. 

There exists an interplay between subdifferentials of the value function and min- 
imizers. For instance, in Section 3 we show that, if y is a minimizer to the last 
problem and if the subdifferential of V at (t, x) is nonempty, then the difference 
quotients j v ^ h j~ x j are bounded (Proposition |3.2| ). 

Many results about Bolza problems with smooth data were extended to the 
case of lower semicontinuous L and (p. In such case, under Tonelli's assumption 
( |1.2|) , H is merely upper semicontinuous and, for this reason, it is natural to look 
for an extension of the viscosity solutions theory to this situation. Also in such 
general case V is only lower semicontinuous, which creates additional difficulties in 
formulating maximum principles yielding uniqueness. However we prove that V is 
locally Lipschitz on R^_ x R n , whenever L is locally bounded, even if the data L 
and ip are discontinuous (Corollary [0|). 

In the case of lower semicontinuous solutions and Hamilton- Jacobi-Bellman equa- 
tions related to Mayer's problem of optimal control theory, a maximum principle for 
lower semicontinuous functions was proposed in [[ji], Barron and Jensen] to deduce 
uniqueness of solutions to the Hamilton-Jacobi equation (corresponding to Mayer's 
problem). In [^0|, the same uniqueness result was obtained by exploiting prop- 
erties of the epigraph of the solutions of the Hamilton-Jacobi equation. 

When L is continuous, we prove (Theorem |4.1| ) that V is the unique lower semi- 
continuous function which satisfies the initial condition V(0, •) = cp and solves the 
Hamilton-Jacobi equation ( |1.4[ ) in the following sense: 



(1.6) V (t,x) £ dom(V), t > 0, 3 u G R n , D^V{t,x)(-l,u) < -L(x,u) 

(1.7) V (t,x) e dom(V), Vn € R n , D±V(t,x)(l,—u) < L(x,u). 
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where D^V(t,x) and D\V(t, x) are the lower and upper contingent derivatives of V 
at (t, x), whose definition is recalled in Section 2. We underline that they coincide 
with Dini's lower and upper derivatives where V is locally Lipschitz. 

Contingent inequalities for discontinuous functions were introduced in [||, Aubin] 
to study lower semicontinuous Lyapunov functions. They were introduced indepen- 
dently in the context of Lipschitz functions (and Dini's directional derivatives) in 
[p9| , Subbotin] to investigate Isaacs' equation of differential games. In |l8j contingent 
inequalities were used to study lower semicontinuous supersolutions of Hamilton- 
Jacobi-Bellman equation of optimal control. 

Under the same assumptions we prove also (Theorem p~5| ) that the restriction 
of V to JR5. x R n is the unique locally Lipschitz function which satisfies the initial 
condition 

(1.8) liminf V(h, y) = <p(x) 

and solves the Hamilton-Jacobi equation ( |1.4| ) in the following generalized sense 



(which is weaker than (L6) and (|1.7| )): 



V (t,x) £ R\x R n , V (pt,Px) £ d-V(t,x), p t + H(x,- Px ) = 0, 

where d-V(t,x) denotes the sub differential of V at (t,x). 

Moreover we prove that the restriction of V to 121. x R n is the unique locally 
Lipschitz function which satisfies the initial condition (|l.8| ) and solves the Hamilton- 



Jacobi equation (1.4) in the viscosity sense: 

V(t,x)Gfi* + xfi n , \/ (pt,p x ) £ d—V(t,x), Pt + H(x,- Px )>0, 

V(t,x)Gfi* + xfi n , V (p t , Px ) e d+V(t,x), Pt + H{x, -p x ) < 0, 

where d + V(t,x) denotes the superdifferential of V at (t, x). We have been not able 
to prove that there is only one lower semicontinuous viscosity solution. For this 
reason we have to adopt a rather unusual notion of solution in our uniqueness result 
for lower semicontinuous solutions. 

When L is discontinuous and locally bounded, we prove (Theorem |5.1| ) that 
V is the unique lower semicontinuous function which satisfies the initial condition 



V(0, •) = (p and solves the Hamilton-Jacobi equation (1.4) in the following sense: 
V (t, x) E dom(U), t > 0, 3 u G R n , D^V(t, x)(-l, u) < -L(x, u), 
V (t, x) e dam(V), V u£R n , D;V(t, x)(l, -u) < L + (x, u), 
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where L + is defined by 

L + (x, u) = limsup — inf { f L(y(s),y'(s))ds : y{—h) = x — hu, y(0) = x\ 
h ^o+ h VJ-h J 

(see [16j and Amar, Bellettini, Venturini]). 

Under the same hypotheses we prove also (Theorem that the restriction of 
V to R^_ x R n is the unique locally Lipschitz function which satisfies the initial 
condition (|1.8|) together with the additional condition 



(1.9) Vxefi", VAX), lim V(h, y) = <p(x), 

h— >0+, y—>x 
\y—x\<\h 



and solves the Hamilton-Jacobi equation ( |1.4|) in the following sense: 

V (t,x) e R* + * R n , V (pt,Px) £ d—V(t,x), p t + H(x,- Px )>0, 

V (t,x) £ R\x R n , \/ueR n , D4.V(t,a;)(l,-«) < L + (i,u). 

In all these theorems, the uniqueness is obtained by proving suitable comparison 
results for the corresponding notions of sub- and supersolution. In particular, we 
extend here a result from jl{| proved in the context of Mayer's problem with bounded 
dynamics, and show (Corollary |5.3| ) that, if ( |1.3| ) holds true, then the value function is 
the smallest lower semicontinuous function satisfying the initial condition V(0, •) = if 



and the contingent inequality (1.6) 



Recently solutions to the Hamilton-Jacobi equation of a nonautonomous Bolza 



problem were investigated in |23| , Galbraith]. However the results of [23 do not 
overlap with ours, since the assumptions of that article imply that the Hamiltonian 
is locally Lipschitz. 

2 Preliminaries 

Let K C R n be a nonempty subset and x € K. The contingent cone Tk(x) to K at 
x is defined by 

v € Tk(x) -i==? lim inf ( x — _ _ 

h^o+ h 

The negative polar cone T~ to a subset T C R n is given by 

T~ = {v £ R n : VweT, (v,w) < 0}. 
We recall the following result due to Cornet |Uj] (see also M). 
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Theorem 2.1 Let K C R n be a closed subset and x € K. Then 

Liminf co T K (y) = C K {x) C T K (x), 

where Liminf denotes the topological lower limit (in the Painleve-Kuratowski sense) 
and Ck{x) denotes Clarke's tangent cone to K at x. 

Let W: R n — > ML) {+00} be a lower semicontinuous function. The subdifferential 
of W at x G dom(W) is defined by 

= (p e fi n : liminf W(y) - W(x) - (p,y - x) Q | 

By © (or |]) 

(2.1) P ed-W(x) (p,-l) G [r £pi(w0 (x,W(s))]~, 
where £pi(W) denotes the epigraph of W defined by 

5pi(W0 : = K x > r) £R n xR:r> W(x)} . 

An equivalent definition of subdifferental uses directional derivatives of W de- 
fined by 

(2.2) V u £ R n , D^W(x)(u) = liminf ^ + M-^) . 

/»^o+ ft 

Clearly for every x G dom(H^) 

(2.3) £pi(D } W{x){-)) = T £pi{w) (x, W(x)), 
and therefore 

(2.4) ped-W(x) \/veR n , (p,v) < DfW(x)(v). 

The upper directional derivative of W at x in the direction u is defined by 

v c *?« n u/r v ^ r ^(x + H-VK(x) 
v u £ R , Di W {x){u) = limsup . 

/1-+0+ ft 

t)-»M 

The superdifferential <9 + VF(x) of W at x is defined by d + W(x) = — <9_(— W)(x) or, 
equivalently, by 

(2.5) p£d + W(x) \/veR n , {p, v) > D±W(x)(v). 
We shall need the following version of Rockafellar's result (see J27|). 



Lemma 2.2 Let x G dom(M^) and let (p, 0) G Tgpi^(a;, W(a;)) 
p / 0. TTten i/iere exisi x £ converging to x (as e — > 0+j and 



6e suc/i i/iai 



(p £! 9e) e [r £pi(w) (a; e , W(x e )) 
converging to (p, 0) as e — > 0+ suc/i iaai g £ < 0. 

A closed subset K of R n is called a viability domain of a set-valued map G: R n 
R n if for every x G K 

G(x)nT K (x) + . 

The following formulation summarizes several versions of the viability theorem (see 
1 and §). 

Theorem 2.3 (Viability) Suppose that G: R n M n is an upper semicontinu- 
ous set-valued map with compact convex values. For a closed subset K C R n the 
following conditions are equivalent: 

(a) K is a viability domain of G; 

(b) G(x) flcoTx(x) 7^ for every x G K; 



(c) for every xq G K there exist e > and a solution x: [0, e[ i— > K to the Cauchy 
problem 

, , fx'(t)GG(x(t)), 
1 j U(0)=«o. 

The equivalence (a) -<=>■ (b) was proved in [p4}| . This proof was simplified in j|, 
p.85]. The fact that (a) (c) was first proved by Bebernes and Schuur in [11|. A 
proof can be found in @ or f5[. 



3 The value function of the Bolza problem 

Consider a lower semicontinuous function L: R n x R n i— > J? + and an extended 
lower semicontinuous function ip:R n ^ J2+ U {+oo}, not identically equal to +oo. 
Throughout the whole paper we suppose that L is convex in the second variable and 
that the coercivity assumption (|1.2| ) holds true. Without any loss of the generality 
we also assume that G is convex. 

Given to > and xq G R n , let us consider the Bolza problem: 

minimize / L(y(s),y'(s))ds + <p(y(t )) 
Jo 
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over all absolutely continuous functions y £ W l,1 (Q,tQ] R n ) satisfying the initial 
condition y(0) = xq. The dynamic programming approach associates with this 
problem the family of problems (t > 0, x £ J? n ): 

minimize / L(y(s),y'(s))ds + ip(y(t)) 
Jo 

over all absolutely continuous functions y € Vl^ 1 ' 1 (0, t; R n ) satisfying y(0) = x. The 
value function V: R + x R n i— > -R+ U {+00} is defined by 

(3.1) V(t, x) = inf I jT* L(y(s),y'(s))ds + cp(y(t)) : y(0) = x\ . 



Proposition 3.1 Under the above assumptions for all (t, x) £ R + xR n the infimum 



in (3.1) is attained (it may be infinite) and V is lower semicontinuous on Fi 
Furthermore, if L is locally bounded, then V has finite values on R*, x 



xR n . 
l n and 



satisfies (1-8) and (l.i) . 



Proof— The existence of a minimizer is a well known result. For the reader's 
convenience, we sketch the proof of the lower semicontinuity of V. Consider a 
sequence (U,Xi) £ J? + x R n converging to (t, x) such that V(ti,Xi) converge to 



lim inf 



(s,y)->(t,x) 



V(s,y). Let yi be the corresponding minimizers of flD]) with (t, 



replaced by If lim V(t{ 



+00, then 



V(t,x) < . lim V(ti,Xi) . 



Assume next that the above limit is finite. Hence for some M for all i, 

rti 







L(yi(s),y'i(s))ds < M. 



Set yi(s) = Xi for s > tj. By the coercivity assumption (|1.2|) , the sequence y[ 
is equiintegrable on [0,t + 1]. This, the Dunford-Pettis criterion (see, e.g., [|T^ , 
Theorem 11.25]), and the Ascoli-Arzela theorem yield the existence of a subsequence 
yi k converging uniformly to some y on [0, t + 1] such that y[ k converge to y' weakly 
in L . We denote this subsequence again by g/j. Then y(0) = x and yi{ti) — > y(t). 
Fix < e < t. Then for all large i, 

U rt—e 

L(yi(s),y'i(s)))ds > / L(yi(s),y-(s)))ds. 
Jo 
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Since L is lower semicontinuous and convex in the second variable, from the lower 



semicontinuity theorems by Olech and Ioffe p5| (see also 12, Theorem 2.3.3]) 
it follows that 

rt—e rt—e 

lim inf / L(yi(s), y-(s)))ds > / L(y(s),y'(s))ds. 

»-+oo Jo Jo 

Thus 

rt—e 

lim inf / L(yi(s), y-(s)))ds > / L(y(s),y'(s))ds. 

t^oo Jo Jo 

Since J <_£ L(y(s),y'(s))ds converges to J L(y(s),y'(s))ds when e — > 0+, the lower 
semicontinuity of <p yields lower semicontinuity of V. 

Since (p is not identically +00, it is clear that V is finite on x M n whenever 
L is locally bounded. 

To prove (1.9) consider a sequence (/ij,Xj) — » (0+,x) such that (x» — x)//ij is 
bounded. Then, by lower semicontinuity of V, 

lim inf V(hi,Xi) > V(0,x) = ip(x), 

i— »oo 

/•hi 

^(^jxO < + / L(xi + s(x - Xi)/hi,(x - Xi)/hi)ds. 
J 

Passing to the upper limit when i — > 00, and using the fact that L is locally bounded, 
we obtain fll.9| ). Condition ( |1.8| ) follows now from ( |1.9| ) and from the lower semi- 
continuity of V. □ 

Proposition 3.2 Xei (t, x) G dom(y), mi/i £ > 0, and Zet y be a minimizer of ( \3. 1\ ). 
Assume either that d-V(t,x) is nonempty or that (l.c) holds. Then the set 

y{h) - x' 



(3.2) 

is bounded in R n . Furthermore, if 



h 



h>0 



y(hi) — x 

(3.3) > u 

tli 

for some hi — > 0+, then 

(3.4) DiV(t,x)(-l,u) <-L(x,u). 
Consequently, V is a viscosity supersolution to i- e -> 

(3.5) V(t,x) xM n , V (pt,Px) G d-V(t,x), Pt + H(x, -p x ) > 0. 
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Proof — First we observe that for all < h < t 

(3.6) V(t, x) = V(t - h, y{h)) + [ k L(y(s),y'(s))ds. 

Jo 

Step 1. Let us prove that ( |3~^ ) is bounded. If (|l~3| ) holds, then (|3T2|) follows 
from 0]. Suppose now that d_F(i, x) is nonempty. If ( |3.2[ ) does not hold, then there 
exists a sequence /i, — > 0+ such that 

\y(hi) — x\ 

(3.7) l - -» +oo. 

Taking a subsequence, still denoted by /ij, we may assume that for some v € R n 

y{hj) ~ x _^ 

\y{K)-x\ 

Fix (pt,Px) £ <9_y(f,x). By the definition of sub differential 

(3 8) Um inf V{t ~ h, y(h)) - V(t, x) - {(pt,p x ), (~h, y(h) - x)) > Q 
h^o+ h + \y(h) — x\ 



which yields, by (|3.6|), 



1 f hi 

limsup — — — — 1 / L(y(s),y'{s))ds < - (p x ,v) . 

i^oo hi + \y(hi) - x\ Jo 



By (1.2) this inequality implies that there exists a constant c > such that 



Vie IV, — / *e(y'(s))ds < c(l + 
hi Jo v 



hi 

By Jensen's inequality we obtain 

-y(hi) ~x\ / \y(hi) - x\ 



V!eJV ,e(mp )£c ( 1 + 



By ( |3.7| ) this contradicts the coercivity assumption (|1.2| ) and ends the proof of our 
claim. 

Step 2. Let us fix R > and e > 0. We want to prove that there exists S > 
such that 

(3.9) V£eB(x,6), Vu£B(0,R), L{£,u) > L{x,u) - e. 
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We start by observing that the function L(x, •) is continuous, since it is convex and 
finite valued. Thus for every v G B(0,R) there exists p\ = pi(v,e) > such that 

V u G B(v, pi), L(x, v) > L(x, u) — ^. 

As L is lower semicontinuous, for every v G B(0,R) there exists p2 = p2(v,e) > 
such that 

V(£%p 2 ), VueB(v, P2 ), L{i,u)>L{x,v)- £ -. 

Putting r = r(v,e) = min{pi(v, e), P2^v, e)}, it follows that 

V^Gfl(i,r), Vu£%r), L(£, u) > L(x, u) - e. 

By compactness there exists a finite set {v\, . . . , Vk} contained in B(0, R) such that 
B(0,R) C B(vi, r\) U • • • U B(vk,rk), where = r(vi,e). It is then clear that (|3,9| ) 
is satisfied with 5 = min{ri, . . . , r^.}. 



Step 3. Consider now a sequence hi —> 0+ and u G M n such that ( |3.3| ) holds. 
By (|3.6|) we have 



(3.10) Z? T F(t,x)(-l,u) < -limsup-J- f ' L(y(s),y'(s))ds. 

i — >oo J 



From ([3^) and ( |3.8|) we obtain 

1 



1 Z - ' 1 * 

limsup— / L(y(s),y (s))ds < p t - {px,u). 

i— >oo JO 



By (L2) this implies that there exists a constant C > such that 



(3.11) VieW, i ( K &(y'(s))ds < C. 

hi Jo 

Let us fix R > and e > 0. By ( |3.9| ) for i large enough we have 

(3.12) L(y(s),y'(s))>L(x,y'(s))-e 
for every s G [0, hi] such that < R. For every i let 

Ai = {s G [0, ^] : < R}, B t = {s G [0, ^] : > R}, 

and let #(i?) = min{G(w) : |u| > i?}. Then 

li 



where | • | denotes the Lebesgue measure. Consequently \Ai\ > t(R) hi, where 

C 



-(R) = (l 



0{R) 



1 as R — > +00. 



By ( 3.12j ) we have 



1 

hi 



K T (TJ) 

L(y(s),y'(s))ds> 



\Ai\ J Ai 



L(x,y'(s))ds - e, 



and by Jensen's inequality we obtain 



(3.13) 



1 f hi 

T / L(y(s),y'(s))ds >t(R) L(x,Ui) - e, 
hi Jo 



where Ui = \Ai\ 1 J A y'(s)ds. For every v £ R n let oj(v) = \L(x,u + v) — L(x,u)\. 
Since L(x, •) is continuous at u, the function to is continuous at and o;(0) = 0. 
From ( gl3|) we have 



(3.14) 



L(y(s),y (s))ds > t(R) L(x, u) — u)(ui — u) — e. 



In order to estimate |u 7 - — u\, we notice that 



\Ui — u \ < 



1 f y> {s)ds _ J_ y> (s)ds 

%\ JA, hi Jo 



where 



Therefore 



y(hi) - x 



hi 



as i — > 00. 



(3.15) \ Ul - u\ < ±- I \y'(s)\ds + (J- - I) / 
\Ai\JB,, K \Ai\ hi' Jo 



Let us define 



C(R) = min 



\Ai\ hi' Jo 

e(v) 



\y'(s)\ds + ei. 



\v\>R \v\ 

By ( |l.2|) Q{R) — > +00 as -R — > +00, and there exists a constant a > such that 
Q(v) > \v I — a for every t> £ J? n . From (3.15) we obtain 



U,- — M 



12 



< 



c 



+ 



l)+Bi. 



t(R)((R) v ^t(R) 
Since t(R) — > 1 and ((R) — > +00 as -R — > +00, we have 

|«i — «| < cr(-R) + £i, 
where o~(R) — > as — > +00. Therefore we deduce from ( |3.10|) and ( 3.14 ) that 

D r V(t,x)(-l,u) < -t(R)L(x,u) + uj(a(R)) + e, 
for every R > and e > 0. Taking the limit as R — > 00 and e — > 0+ we obtain (|3.4| ). 



Step 4. Let us prove ( |3.5| ). Pick (pt,p x ) £ 9-V(t, a;) and it satisfying ( |3.3j ). 
From (2.4) an d (|3.4| ) we get + {—p x ,u) — L(x, u) > 0. The conclusion follows from 
the definition (|l.5| ) of H. □ 

Proposition 3.3 Assume that L is locally bounded and let (to,xo) € x R n . 
Then there exist r > and (5 > such that for all (t,x) E B((to, xq), 5) every 
minimizer y(-;t,x) of l\3. \) is r—Lipschitz. 



Proof— According to ||, Theorem 4.1] for every minimizer y(-) := y(-;t,x) 
of ( |3.1| ) there exists k(t,x) such that for some p(s) € d u L(y(s),y'(s)) 

(p{s),y'(s)) - L{y(s),y'{s)) = k(t,x) for a.e. s G [0,i]. 

On the other hand, since L is locally bounded, for some Mi > and for all (t, x) 
sufficiently close to (£q,£o) 



L(y(s;t,x),y'(s;t,x))ds < M 1 



This and coercivity assumption ( |1.2Q imply that y'(-;t,x) are equiintegrable and 
therefore y(-;t,x) is uniformly bounded in L°° for near (to,^o). Furthermore, 
there exists R > such that for all sufficiently close to (to,^o) the sets 

A(t,x) := {s E [0,t] : \y'(s;t,x)\ < R} 

have positive measure. Since L is locally bounded, 



sup sup L(y(s;t, x),u) < M2 < 00 

s£[0,t] u£B(0,2R) 
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for all (t, x) sufficiently close to (to,xo)- This implies that for some M3 < +00 
L(y(s;t,x), •) is M3— Lipschitz on B(0,R) for (t, x) near {to,xo) ( see > e -S-i lH Proof 
of Theorem 2.1]). Hence for almost every s 6 A(i,x) we have |(p(s),?/(s))| < M3R, 
which implies 

\k{t,x)\ < M 2 + M 3 R. 

Consequently, k(t,x) is bounded in a neighborhood of (to,xo). By ]2|, Proof of 
Theorem 4.2], y(-;t,x) are Lipschitz with the same Lipschitz constant whenever 
(t,x) is sufficiently close to (to,xo)- □ 

Corollary 3.4 If L is locally bounded, then V is locally Lipschitz on R* + x M n . 

Proof— Fix (£o,£o) e -^4- x c dom(V). By Proposition [T^, there exist 
r > and 5 > such that for all € B((to, Xo), 5) every minimizer y(-;t,x) of 

( |3.1[) is r— Lipschitz. We may assume that 55 < to. Let (ti,xi) and (£25^2) be two 
distinct points of B((to, xq), S), let /ii = |ij — ^1 + \%i — x 2 \, and Si = hi — ti + £2- 
Let ui € J? n be such that y(si; ^2 , £2) = xi + fomi. Then < hi < t%, < s± < 2h±, 
and 

fo-\R\ 1 1 ^ l2/( s i^2,X2) ~x 2 \ \x 2 -xi\ 

(3.16) |«i| < 1 <2r + l. 

hi hi 

Let yi\ [0, ti] 1— > J? n be the function defined by 

xi + sui if < s < hi, 



y(s - ti + t 2 ;t 2 ,x 2 ) ifhi<s<ti 



Then 



V(ti,xi)< L(yi(s),y'i(s))ds + ip(yi(ti))= L(xi + su\, ui)ds 
Jo Jo 

+ / L(y(s;t 2 ,x 2 ),y'{s;t 2 ,x 2 ))ds + ip{y(t 2 ;t 2 ,x 2 )). 

Jsi 

As si = hi — ti + 1 2 > and L > 0, we obtain 

V(ti,xi) < / L(xi + sui,ui)ds + V(t 2 ,x 2 ). 



Since L is locally bounded, it follows from (|3.16| ) that there exists a constant M, 
depending only on L, to, xq, 5, and r, such that 

V{ti,xi) - V{t 2 ,x 2 ) < Mhi = M(\ti-t 2 \ + \xi-x 2 \). 
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Exchanging the roles of (ti,xi) and (£21^2) we obtain that V in M— Lipschitz on 
B({t ,x ),S). □ 

When L is discontinuous, different contingent inequalities have to be introduced, 
which involve the function L + (x,u) defined by 

L + (x,u) = lim sup — inf { / L(y(s),y' (s))ds : y(—h) = x — hu, y(0) = xX 
h^o+ h U-h ) 

(3.17) = lim sup — inf < / L(y(s), —y'(s))ds : y(0) = x, y(h) = x — hu 1 . 

h-+o+ h [Jo 



Remark 3.5 The function L + {x,u) was introduced in pi. In that paper it was 
shown that, if for some positive constants D, d and p > 1 we have 

V (x,u) & M n x R n , d\u\ p < L(x,u) < D(l + \u\ p ), 

then L + (x, •) is continuous for every x S M n and convex for almost every x € R n . 

Clearly for all u the function L + (-,u) is smaller than or equal to the upper 
semicontinuous envelope of L(-,u). 



Proposition 3.6 If L is locally bounded, then L + (x,u) > L(x,u) for all (x,u) 6 
M n x M n . Moreover, if Vh — > u as h — > 0+, then 



L + (x,u) = lim sup i inf ( f L(y(s),y'(s))ds : y{-h) = x - hv h , y(0) = xX . 

h^o+ h yj-h J 

In particular L + = L when L is continuous. 

Proof — Let us fix (x, u) and x>h as in the statement of the proposition, and 
let L(x, u) be the right hand side of the formula to be proved. We want to show 
that L(x, u) < L + (x, u). For every h > let = — u\ and let y^ be a minimizer 
of the problem 

inf 1 / L(y(s),y'(s))ds : y(-(l - e h )h) = x - (1 - e^/m, y(0) = xl . 

^-(l-e h )h J 

For all s G [— h, —(1 — £/i)/i] set 

Vh ~ (1 - 



y A (a) = x - (1 - e ft )/in + (s + (1 - e A )/i)- 
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Then yh(—h) = x — hvh- Since (vh — (1 — Sh)u)/sh is bounded, we deduce that for 
some M > and all h > 0, 



L(yh(s),y' h (s))ds < / L(y h (s),y' h (s))d, 

h J-{l-e h )h 



-(l-e h )h 

s+ I Mds. 

h 



Dividing by h and taking the upper limit when h — > 0+ we get L(x,u) < L + (x,u). 
The opposite inequality can be proved in the same way. 

To prove that L + (x,u) > L(x,u), for every ft, > let yh be a minimizer of the 
problem 

inf jy L(y(s),y'(s))ds : y(-h) = x - hu, y(0) = xX . 

Observe that L + (x,u) is finite, because L is locally bounded. By Q there exist fc/j 
such that for some G d u L(y h (s),y' h (s)) 

(Ph(s),y' h (s)) - L(y h (s),y' h (s)) = k h . 

We set yh(s) = yh(—h) = x — hu for s < —h. Then for some M > 

'° L{y h {s),y' h {s))ds<M. 



Arguing as in the proof of Proposition |3.3| , we deduce that the sequence kh is 
bounded. By [^, Proof of Theorem 4.2] the sequence y' h is bounded in L°°. 

Let £ > 0. Since L is lower semicontinuous and continuous in the second variable, 
for all h small enough 

L {yh{s),y' h (s)) > L(x, y' h (s)) - e a.e. in [-h, 0] 



(see Step 2 in the proof of Proposition |3.2|). Integrating and using Jensen's inequality 
we get 

1 f° , If 

L(yh(s),y' h (s))ds > t / L(x, y' h {s))ds -e> L(x, u) - e. 



h J-h h 

Taking the upper limit when h — > 0+ and e — > 0+ we obtain L + (x, u) > L(x,u). 
If L is continuous, we have also L + < L by Remark [3.5|, hence L + = L. □ 



We generalize now a result obtained in jjj under some additional growth condi- 
tions. 
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Proposition 3.7 Assume that L is locally bounded. Let y: [0, T] \— > R n be a Lips- 
chitz function. Then L(y(t),y'(t)) = L + (y(t),y' (t)) for almost every t G [0, T]. 

Proof— We already know that L + > L. To prove the opposite inequality, we 
fix a function y as in the statement of the proposition. Since L is locally bounded, 
the function t i— ► ip(t) := Jg L(y(s),y'(s))ds is absolutely continuous. Let t G [0, T] 
be such that both i()'(t) and y'(t) do exist and ^>'(i) = L(y(t),y'(t)). Since = 
(y(t) — y(t — h))/h converges to y'{t) as h — > 0+, from Proposition |3.6| we obtain 

L + (y(t),l/(t))< lim ± /* L(y( s ),y / ( s ))d s = V / (t) = ^(y(t),y'(t)), 

which concludes the proof. □ 



4 The Hamilton-Jacobi equation 

In this section we suppose that L is continuous and we consider three different no- 



tions of generalized solutions of the Hamilton-Jacobi equation ( |1,4| ). In Theorem 4.1 
we prove that the value function V defined by ( |3.1| ) is the unique lower semicontin- 
uous solution of the Hamilton-Jacobi equation in a suitable generalized sense, 
expressed in terms of contingent inequalities. Then we restrict our attention to lo- 
cally Lipschitz solutions, and we look for uniqueness results for weaker (and more 
usual) notions of solutions. In Theorem 4.5 we prove that V is the unique locally 
Lipschitz function which satisfies the Hamilton-Jacobi equation in the following gen- 
eralized sense: 

V(t,s) £RX xR n , V (pt,Px) £ d-V(t,x), p t + H(x,-p x ) = 0. 



Finally, in Theorem 4.6, we prove that V is the unique locally Lipschitz viscosity 
solution of fOI). 



Theorem 4.1 Assume that L is continuous. Then V is lower semicontinuous on 
R+ x R n and solves the Hamilton-Jacobi equation ({1-4D in the following sense: 

(4.1) V (t,x) £ dom(V), t > 0, 3 u £ R n , D^V(t,x)(-l,u) < -L(x,u), 

(4.2) V (t,x) G dam(V), Vti G R n , DjVfjt, x)(l, -it) < L(x, u). 

Let W: R+ x R n ^ R + U {+00} be a lower semicontinuous function which 
satisfies the initial condition W(0, •) = tp. If W is a supersolution of the Hamilton- 
Jacobi equation ([i.^, in the sense that 



(4.3) V (t,x) G dom(W), t > 0, 3 u G R n , D^W(t,x)(—l,u) < —L(x,u), 
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then W > V on R + x R n . If W is a subsolution of the Hamilton- J acobi equation 
(1-4), in the sense that 

(4.4) V (t, x) G dom(iy), V u G R n , D L W(t, x)(l, -u) < L{x, u), 

then W <V on R + x R n . 

Therefore V is the unique non negative lower semicontinuous function which 
satisfies the initial condition V(0, •) = <p and solves the Hamilton- J acobi equation 
(1-4) in the sense of and &4-Q) - 



Proof— The lower semicontinuity of V is proved in Proposition |3.1|. Condition 



(4.1) follows from Proposition 3.2. Let us prove (4.2). Fix (i, x) G dom(y) and 
u G R n . Observe that for all h > and v £ R n we have 

V(t + h, x — hv) — V(t, x) < I L{x — sv,v)ds. 



o 



Dividing by h and taking the upper limit when h — > 0+ and «->uwe obtain 

Let W be as in the statement of the theorem. Assume that TV is a supersolution, 



i.e., W satisfies (gj). Let (t,x) G dom(W), t > 0, and e > 0. By (gj) and (|4. 
there exist hi — > 0+ and U{ — > u such that 

W(t — hi,x + hiUi) < W(t, x) — hiL(x, u) + ehi. 

Since L is continuous, for all sufficiently large i we have 

W(t — hi,x + hiUi) + / L(x + sui, ui)ds < W(t, x) + 2eh{. 

Consider the set A of all pairs (<r, y) £ ]0,t] x W 1 ' 1 ^, a; R n ) such that 

y{0) = x & W{t-a,y(a))+ f L(y(s),y'(s))ds <W(t,x) + 2e<T. 

Jo 

The set A is nonempty by the first part of the proof. We introduce the following 
partial order on A: we write (a, y) « (r, z) if a < r and y is the restriction of z to 
[0,*]. 

We claim that for every totally ordered subset B of A there exists (r, z) G A 
such that (a, y) « (t,z) for every (a,y) G B. Indeed let 

r = sup a 

(cr,y)eB 



18 



and consider a sequence (cr^j/j) € B with Oi — > r. Define z: [0, r[ i— > R n by setting 
z(s) = Vi(s) whenever s < a- L . As B is totally ordered, the function z is well defined 
and, if (cr, y) € B with cr < r, then y coincides with the restriction of z to [0, cr]. 
Since > we deduce that for some c and for all % 

U 

L (yi(s),y'i(s))ds < c. 

Set yi(s) = yi{(Ti) for all s S ]<Tj,r]. Since L satisfies the coercivity assumption ( |1.2| ), 
y^ are equiintegrable on [0, r]. Consequently, yj are equicontinuous on [0, r]. So z 
can be extended by continuity at r, z belongs to W 1 ' 1 (0, r; R n ) and (r, z) belongs 
to A (recall that W is lower semicontinuous) . It is clear from the construction that 
(cr, y) « (t,z) for every (cr, y) G B. 

By Zorn's lemma there exists a maximal element (cr, y) £ A. We claim that 
a = t. Indeed, if not, then acting as at the beginning of the proof, we construct 
(r, z) € A with a < r < f and (cr, y) << (r, z), which contradicts the maximality. 
So 

V(t, x) < W(0, y(t)) + / L(y(s),y'(s))ds < W(t, x) + 2et. 



The number e > being arbitrary, we conclude that V(x,t) < PF(x, t). 

Suppose now that W is a subsolution, i.e., W satisfies fl4.4p . Let us fix i > 
and x € -R n , and let y be a minimizer of Q3.1| ). Since L is continuous, Ql,3| ) 
holds true. Thus y' € L°°(0,t; R n ) by 0. Consider a sequence of continuous 
functions U{\ [0, i] i— > -R n which is bounded in L°°(0, t; M n ) and converges to y' almost 
everywhere in [0,t], and define 

2/iO) = y{t) ~ [ Ui{T)dT. 



Then j/j converges to y uniformly in [0, i]. Fix i and set = W(s,yi(t — s)) for 
< s < t. By ( [4.4| ) for every s G dom(^), with s < t, we have 

(4.5) D^(s)(l) < L( yi (t - s), Ui (t - s)). 

Consider the closed set 

K = £pi(ifj) U ([t,+oo[ x R), 

and the system 

{a\s),z'(s)) = (l,L(y i {t-s),u l (t-s))), 
(a(0),z(0)) = (0,<p(y(t))). 



(4.6) 
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It has the unique solution 

(4.7) (a(s), z(s)) = (s, <p(y(t)) + jT L( yi (t - r),«i(t - r))dA . 



According to ( |2.3| ), Theorem [2^, and (|4.5|) , this solution is viable in X, i.e., for all 
s e [0,t], (a(s),z(s)) G K. Thus for all s < t 

(4.8) W r («,w(*-«))<¥'(y(*))+ f L{ yi {T), Ui {T))dr. 

J o 

Since L is continuous and is lower semicontinuous, from the Lebesgue Theorem 
we obtain 

(4.9) W(t, x) < y{y{t)) + / L(y(r),y' '(r))dr, 

jo 

which gives x) < V(i, x)- □ 

Remark 4.2 In the previous theorem, the comparison result for subsolutions re- 
mains true, if we assume that (4.4) holds only for t > 0, provided that W satisfies 
also condition (|4.20|) of the next theorem. In this case fl4.5| ) holds only for s > 0, 
but we can modify the proof in the following way. We fix ti — * 0+ and Xi — * y(t) 
such that W(ti,Xi) — > tp(y(t)), and define 

rt—ti 

yi(s) = Xi- Ui(r)dr, 



for < s < t — t i Consequently, ip(s) is defined only for U < s < t, and (|4.5| ) holds 
only for U < s <t. Then we replace by ti and ip(y(t)) by W(ti,Xi) in ( |4.6[ 
and we obtain (14.91) as before. 



Remark 4.3 The following example shows that we can not remove the assumption 



W > in Theorem 4.1 even if L does not depend on x. Let n = 1, L(x,u) = 
7j|«| 2 , <^(x) = 0. Then x) = and H(x,p) = ^\p\ 2 - Let us consider the lower 
semicontinuous function W : J2+ x M n i— > 1? defined by 



W(t,a:) 



if ix < 1, 

-(tx - l) 1 / 2 - x 3 - xt~ 2 iftx>l. 



By direct computation one checks that for tx ^ 1 the function W is differentiable 
and 

W t (t,x) + H(x,-W x (t,x)) = W t (t,x) + l\W x (t,x)\ 2 > 0, 
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which implies that 

(4.10) 3u£R n , D^W(t, x)(-l, u) < -L(x, u). 
On the other hand for tx = 1 we have 

Vu>l/t 2 , D^W(t,x){-l,u) = -co, 

which implies ( f4.10| ) also in this case. Therefore W satisfies ( [4.3[ ), but W(t,x) < 
V(t,x) for tx > 1. 

The following proposition shows the equivalence between the notion of subsolu- 
tion considered in the previous theorem and a notion defined by using subdifferen- 
tials. 

Proposition 4.4 Assume that L is continuous. Let W: R+ x R n \— > R U {+00} be 
a lower semicontinuous function. Then the following conditions are equivalent: 

(4.11) V(t,x)edom(iy), Vuefi", D L W(t, x)(l, -u) < L(x, it); 

(4.12) V(t,x)edom(iy), Vuefi", L> T VF(t, x)(l, -u) < L(z, «); 

(4.13) V (t,x) ER+xR n , V(pt,p x )ed-W(t,x),pt + H(x,-p x )<0. 

The equivalence remains true if dom(M^) is replaced by dom(P^) n (R+ X R n ) in 
j^Hj) and fcp]\) and R + x R n is replaced by R% x R n in ( gTTg j. 

Proof- It is clear that (|4Tl] ) implies ( p^) . Suppose that TV satisfies (p^) . 
Then ( [4.13 ) follows from ( |2.4| ) and from the definition (1.5) of H. 

Conversely, suppose that W satisfies ( |4 . 1 3| ) . We claim that for all (t,x) € 
dom(W) 

(4.14) VuGfi", (l,-u,L(x,u)) £coT £pi{w) (t,x,W(t,x)). 
To prove this fact, let us fix u € R n . Then 

(4.15) V {p t ,p x ) £d.W(t,x), p t + (-p x ,u)-L(x,u)<0. 
We want to prove that 

(4.16) V (pt,p x ,q) G T £pi (w)(t,x,W(t,x)) , p t + (-p x ,u) + qL(x,u) < 0. 



21 



When q < this inequality follows from ([TT|) and ( |4.15| ). By Lemma ^2], if (0, 0, 0) ^ 

(Pt,Px,0) G T gpi (w)(t,x, W(t,x)) , then for some (ti,Xi) ->• (t,x) and {p\,p l x ,qi) G 

W(*»>«i)) > witn ft < 0, we have (p l t ,p l x ,qi) -> (pt,p x ,0). So 

Pt + (~Pl, u ) + ft-^O&i, M ) < 0. 

Taking the limit we get pj + {—p x ,u) < 0, which concludes the proof of ( |4.16[ ). 

By the separation theorem, ( 4.14j ) follows from ( [4.16 ). Thus for all (t,x,r) € 
£pi(W) 

(l,-u,L(x,u)) ecdT £pi{w) (t,x,r). 
From Theorem ^j] and continuity of L we deduce that for all (t,x) £ dom(PF), 

(l,-u,L(x,u)) G C £pi(w) {t,x,W{t,x)). 

Fix e > 0. Then it is not difficult to check that 

V u € R n , (1,-u, L(x, u) + e) € Int (C^w/) (i, x, W(t, x)fj . 

By ]|, Proposition 13, p. 425] this yields 

W(t + h,x-hv) -W(t,x) 



(4.17) 



lim sup 

h—*0+, v—*u 



< L(x, u) + £. 



As £ > is arbitrary, we obtain ( 4.11 ), □ 



We recall that for a locally Lipschitz function ip: R n i— > 1? the contingent deriva- 
tives coincides with the Dini derivatives: 



L't( / 9(x)(n) = d-(p{x; u) := limmt < +oo. 

/i->o+ h 



m n ^ , x / x , x , V(X + hu) — <p(x) 

\/ueR n , D^{x){u) = d + tp(x;u) := hmsup — < +oo. 



p = 0. 



By ( |2.3| ) this implies that 

(4.18) (p,0)G ip{x)) 
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Let W: R\ x 
condition 
(4.20) 



liminf W(h,y) = ip(x). 



Theorem 4.5 Assume that L is continuous. Then V is locally Lipschitz on R+ x 
R n and solves the Hamilton- J acobi equation (L4) in the following sense: 

(4.19) y(t,x)eR\xR n , V( Pt , Px ) ed-V(t,x), Pt + H (x, -p x ) = 0. 

♦ M + be a locally Lipschitz function which satisfies the initial 

M x G 1 

If W is a supersolution of the Hamilton- J acobi equation ( \1.4\ ), in the sense that 

(4.21) V (t, x) G R\ x R n , y(p t ,p x )ed-W(t,x), Pt + H(x,-p x )>0, 

then W > V on R*^ x R n . If W is a subsolution of the Hamilton- J acobi equation 
(1-4), in the sense that 

(4.22) V(t,x) £R* + xR n , V (p t ,p x ) £ d-W(t,x), p t + H(x, -p x ) < 0, 

then W <V on R* + X IT. 

Therefore the restriction of V to R+ x l? n is £/ie unique non negative locally Lip- 
schitz function which satisfies the initial condition ( 4-2C ) and solves the Hamilton- 
Jacobi equation (1.4) in the sense of ( 4-1& )■ 

Proof — The fact that V is locally Lipschitz on R\ x R n is proved in Corol- 

, together 



lary 3A. Property ( 4.1 9| ) follows from Theorem O. Indeed, (|4.1| ) and 
with the definition (|1.5|) of H, imply that 



V (t, x) G R+ x R n , V (pt,p x ) G d-V(t,x), Pt + H{x,-p x )>0; 



the opposite inequality follows from ( [4.2j) and Proposition |4.4| . The initial condition 
fl4.20P for V is proved in Proposition |3.1| . 

Let W be as in the statement of the theorem. Assume that TV is a viscosity 
supersolution, i.e., W satisfies ( 4.21 ). Define 

G(x) = {(-1, u, -L(x, u) - p) : p > 0, u G R n } , 

and fix t > and x G J? n . Since W is Lipschitz around (t,x), d-W is locally 
bounded. By the coercivity assumption fll.2j) there exist R > and J > such that 



V(a,*) eB((t,x),6), V(p t ,p x )ed-W(s,z), V\u\>R, 
Pt + (~Px,u) - L(z, u) < 0. 
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This, ( |4.21| ), and the separation theorem imply that for every (s,z) £ B((t,x),5) 

G{z) n ({-1} x B(0, R) x [-m, 0]) n (coT £pi{w) (s, z, W(s, z))) + 0, 

where m = max{L(z,u) : (z, u) € B(x,5) x B(0,R)}. The above holds true also 
with W(s,z) replaced by any r > W(s,z). From Theorem 2.3 we obtain 

G(x)n({-l}xB(0,R) x l-m,0}) n (T £pi(w) (t,x,W(t,x))) ^0, 

which is equivalent to 

3u€ B(0,R), D^W(t,x)(-l,u) < -L(x,u). 



From Theorem |11| we deduce that W > V on R* + x i? n . 

If W is a subsolution, i.e., W satisfies Q4.22| ), then W < V on R* 
Theorem 4.1 and Remark 4.2. □ 



l n by 



Theorem 4.6 Assume that L is continuous. Then V is locally Lipschitz on R*^ x 
]R n and solves the Hamilton- J acobi equation (1-4) in the viscosity sense, i.e., 

(4.23) V(t,x)eR\xR n , V(pt,Px) €d-V(t,x), Pt + H(x, -p x ) > 0, 

(4.24) V (t,x) € R\ x IT, V (p^) E <9 + F(i,x), Pt + H(x, - Px ) < 0. 



be a locally Lipschitz function which satisfies the initial 



Let W: R\xR n ^ 

condition (4-2C). IfW is a viscosity supersolution of the Hamilton- J acobi equation 



i.e., 

(4.25) V(t,x)€. 

then W >V on R 
equation (l.j ), i.e. 

(4.26) \/(t,x)e. 

then W <V onR%x R n . 

Therefore the restriction of V to R*j_ x R n is the unique non negative locally 
Lipschitz viscosity solution of the Hamilton- J acobi equation ( \1.4 ) which satisfies the 
initial condition (J..2L ). 



\xR n , V( Pt , Px )ed^W(t,x), p t + H(x,-p x )>0, 
x R n . If W is a viscosity subsolution of the Hamilton- J acobi 

\xR n , V (pt, Px ) ed+W(t,x), p t + H(x, - Px ) < 0, 
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Proof- Let us prove ( 4.24| ). Fix (t,x) G dom(V), t > 0, and u G 
Observe that for all small h > we have 

rh 



hence 



f 

V(t,x) <V(t — h,x + hu) + / L(x + su,u)ds, 

J o 

rh 

V(t — h, x + /m)) — V(i, x) > — L{x + su, u)ds. 

Jo 



Dividing by h and taking the upper limit when h — > 0+ we obtain 

J D i F(t,x)(-l,n) > -L(a?,u), 

which implies ( [4.24 ) by ( [2.5D and by the definition ( |1.5| ) of f/\ For the other prop- 
erties of V see Theorem [3~5| . 

Let W be as in the statement of the theorem. If W is a viscosity supersolution, 
i.e., W satisfies ( |Op , then W > V on R* + x R n by Theorem pj~5[ 



Assume now that is a viscosity subsolution, i.e., W satisfies ( 4.26 ). Properties 
( fEll) and flOg ) imply that, for all t > and x G M n , 



T 8pi{ -w) («, a?, - W(t, x))l = |J A (-5+ W(t, 



•1). 



A>0 



Using the separation theorem, from ( [4.26[) we obtain 

V u G R n , (-l,u,L(x,u)) ecoT^^^s, -W(t,x)). 

The above holds true also with — W(t,x) replaced by any r > — W(t,x). So, by 
Theorem f2T[ for alH > and x G l? n , 

Vn£fi n , ( — 1, «, L(x, u)) G ^(^(i, x, -W(t, x)), 



and therefore by (gj) and Q 

Vuefi", Z>jW(t,x)(-l,u) > -L(x,u). 

Fix i > 0, x G l? ra and let y be a solution to (jO|). By ||] it is Lipschitz. Consider 
(ti,Xi) — > (0+,y(i)) such that lim W(ti,Xi) = ip(y(t)). Set 

The function ^(s) := W(t — s, jji(s)) is locally Lipschitz on [0, t[. Fix < s < t such 
that ip'(s) and y'(s) do exist. Using the fact that W is locally Lipschitz we get 

il/ {s) = D^Wit - s, yi (s))(-l,y'(s)) > -Hyiis),^)). 
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Consequently for every < s < t 

W(t - s, yi (s)) - W{t, yi (p)) = ij(s) - ^(0) > - f HyiiT),^))^, 

Jo 

and thus 

W(t i ,x i )+ f ' L( yi (T),y'(r))dT > W(t, Vi (0)). 
Jo 

Passing to the limit when i — > oo and using continuity of L we deduce that W(t,x) < 
V(t,x). □ 

5 The case of a discontinuous Lagrangian 

In this section we do not assume that L is continuous. We can still prove (The- 
orem |5.1|) that the value function V defined by fl3.1|) is the unique non negative 
lower semicontinuous solution of the Hamilton- Jacobi equation ( |1.4[ ), but now we 
have to consider a weaker notion of generalized solution, which involves a contin- 
gent inequality for the function L + introduced in ( |3,17| ). To prove uniqueness in 
the smaller class of locally Lipschitz functions we can use an even weaker notion of 
solution, where the contingent inequality (|5.1[) for supersolutions is replaced by a 
viscosity inequality (Theorem 5.5). 



Theorem 5.1 Assume that L is locally bounded. Then V is lower semicontinuous 
on R + x R n and solves the Hamilton- Jacobi equation in the following sense: 

(5.1) V (t,x) e dom(V), t > 0, 3 u G R n , D r V(t, x)(-l, u) < -L(x, u), 

(5.2) V (t,x) € dom(V), Vti € R n , D^V(t, x)(X, —u) < L + (x, u). 

Let W: R+ x R n i— > R + U {+00} be a lower semicontinuous function which 
satisfies the initial condition W{Q, •) = <£>. If W is a supersolution of the Hamilton- 
Jacobi equation (jl.fy , in the sense that 

(5.3) V (t,x) G dom(W), t > 0, 3 u G R n , D^W(t, x)(-l, u) < -L(x, u), 

then W > V on R+ x R n . If W is a subsolution of the Hamilton- Jacobi equation 
([!■$), in the sense that 



(5.4) V (t,x) G dom{W), Vti G R n , D^W(t,x)(l,—u) <L + (x,u), 

then W <V on R + x R n . 

Therefore V is the unique non negative lower semicontinuous function which 
satisfies the initial condition V(0, •) = </? and solves the Hamilton- Jacobi equation 



(1.4) in the sense of (\5.1\) and pT 



26 



To prove the theorem, we need the following approximation lemma. 

Lemma 5.2 There exists a sequence of continuous functions Lk'.R 11 x R n i— > J? +; 
converging pointwise to L, such that, for all k, Lk(x, •) is convex, < L k+ \ < L, 
and 

(5.5) \/x£R n ,\/u£R n , L k (x,u) >0(u). 



For every k let V k be the value function of problem ( \3. i| j with L replaced by L k . 
Then Vk converge to V pointwise. 

Proof — The proof of the existence of a sequence L k with the required prop- 
erties can be found in Lemma 2.2.3]. It is clear that the sequence V k is non- 
decreasing, so it is pointwise convergent, and that V k < V. We want to prove that 
V < limfc Vk- Let us fix (t, x) in R + x R n such that 

(5.6) lim V k {x,t) < +oo. 

fc^oo 

Let yk be a solution to the problem 

mfy\k(y(s),y'(s))ds + <p(y(t)) : y(0) = x| . 



We deduce from ( |5.6| ) and from the coercivity assumption ( |1.2[ ) that j/j^ are equiin- 
tegrable. Hence yk are equicontinuous. Taking a subsequence and keeping the same 
notations we may assume that yk converges uniformly to some y and y' k converges 
weakly in L 1 (0, t; R n ) to y' . Fix i. Since for every k > i we have 

<p(yk(t))+ [ Li(yk(s),y' k (s))ds < (p(y k (t)) + [ L k (yk(s),y' k (s))ds = V k (t,x), 
Jo Jo 

taking the limit when k — > oo we get 

</>(y(i)) + j U{y{s),y'{s))ds < lim V k (t,x) < V{t,x). 

JO fe^oo 

Taking the limit when i — > oo and using Fatou's lemma we deduce that 
V(t,x) < + f L(y{s),y'(s))ds < lim V^,x) < V(t,x). 

JO ft-^oo 

Thus Vk converges pointwise to V. □ 
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Proof of Theorem |5J 



The lower semicontinuity of V is proved in Propo- 



sition |3.1| . Condition (|5.1| ) follows from Proposition 3^. Let us prove fl5.2|) . Fix 



(t, x) 6 dom(y) and u E R n . By Proposition 3.6 we have 



1 r rO i 
L + (x, u) = limsup — inf < / L(y(s),y' (s))ds : y(—h) = x — hv, y(0) = x 
h^0+ h U-h 



Since for every absolutely continuous function y satisfying y{—h) = x — hv and 
y(0) = x we have 

f° 

V(t + h, x - hv) < V(t, x) + / L(y(s),y'(s))ds, 

J-h 



we deduce that 



< inf 



V(t + h,x - hv) - V(t,x) 
L{y(s),y'{s))ds : y(0) = x, y(-h) = x - hv 



Dividing by h and taking the upper limit as h —> 0+ and v —> u, we obtain (|5.2| ), 

Let W be as in the statement of the theorem. Assume that TV is a supersolution, 
in the sense that ( ^.3[ ) is satisfied. Let and Vk be the continuous Lagrangians and 



the corresponding value functions given by Lemma 5.2. As < L, the function 
W is a supersolution for the problem relative to the continuous Lagrangian L^. 
Therefore W > Vk on R + x R n by Theorem 4.1. Since Vk converges to V pointwise, 
we conclude that W < V on M + x M n . 

Assume now that W is a subsolution, i.e., satisfies ( |5.4|) . Fix t > 0, x £ 1?" 
and let y be a minimizer of Q3.1| ). It is Lipschitz continuous by [||. Set ip(s) = 
W(s,y(t — s)). Thus for almost all s G [0, t], 

(5.7) £> T ^(s)(l) <fl^( S ,i,(t- S ))(l,-i/(i- S )) <L + (y(t- S ),y'(t- S )). 
By Proposition we have 

(5.8) L+(y(i - s),y'(t - s)) = L(y(t - s),y'(t - s)) a.e. in [0, t]. 



Since y is Lipschitz and L is locally bounded, the same argument used for (|5.7] ) 
implies that there exists a constant M such that 

(5.9) Vs€[0,t[, D^(s)(l) < M. 

Define the closed set-valued map s P(s) by 

P(s) = W(s,y(t- s)) + R+, V s € [0,t[ & P(s) = R, Vs>t 
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Using (pTg|) , (|2.3D, and Theorem 2^, we deduce that for every sq G [0, t] and for 
every zq G -P(so) there exists an M-Lipschitz function z: [so,t] h- ► J? n such that 
z(so) = and z(s) G P(s) for every s G [so,t]. This yields that P is left absolutely 
continuous on [0,t], i.e., for any e > and for any compact subset K C -R n , there 
exists 5 > such that for any subdivision < t\ < t\ < ■ ■ - t m < r m < t with 
X)i( T i ~~ £i) ^ ^ we have J2ih(P(U) n K,P(ri)) < e, where h is the Hausdorff 
semidistance: h(A, B) := sup d(a, B). 

ae A 

Consider the viability problem 

(z'(s) =L(y(t-s),y'(t-s)), 
(5.10) <^ z(0) = <p(y(t)), 

[z(s) G P{s). 

According to the measurable viability theorem Theorem 4.2] it has a (viable) 
solution by (|5.7l ) and (^.^). But this solution is given by 

z(s) = ip(y(t)) + L(y(t - r),y'(t - r))dr. 



o 



Thus 



W(t,x) < <p(y(t)) + / L(y{r),y'(r))dr = V(t,x) 
and W < V on R , x K n . □ 



o 



The proof shows that the comparison result for supersolutions in Theorem 5.1 



remains true even if we drop the assumption that L is locally bounded. Therefore 



Proposition 3.2 and Theorem 5.1 imply the following corollary. 



Corollary 5.3 Assume that L satisfies Then V is the smallest non negative 

lower semicontinuous function satisfying the initial condition V(0, •) = ip and the 
contingent inequality f ]5. 



Remark 5.4 In Theorem |5.1| the comparison result for subsolutions remains true, 
if we assume only that ( |5.4|) holds for t > 0, provided that W satisfies condition 
( |5.13| ) of the next theorem. In this case ( |5.9| ) holds only for s > 0, but, to obtain 
the result, it is enough to replace by h > and <p(t) by W(h,y(t — h)) in ( 5.1C| ). 

We consider now the uniqueness in the class of locally Lipschitz solutions. 
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Theorem 5.5 Assume that L is locally bounded. Then V is locally Lipschitz on 
-R* x R n and solves the Hamilton- J acobi equation (1.4) in the following sense: 

(5.11) V(f,x)Gfi;xF, V (pt,Px) G d-V(t,x), p t + H(x,- Px )>0, 

(5.12) V (t, x) G R+ x R n , VueR n , D^V^t, x)(l, -u) < L + (x, u). 

Let W: R+ x R n \— > R + be a locally Lipschitz function which satisfies the initial 
condition ( 4-2(\) together with 



(5.13) 



Vi G R n , V A > 0, lim W(h,y) = (p{x). 

ft—>0+, y^x 
\y—x\<\h 



If W is a supersolution of the Hamilton- J acobi equation ( \1.4 ), in, the sense that 

(5.14) V(t,x) £R\xR n , V (pt,p x )(=d-W(t,x), p t + H(x, -p x ) > 0, 

then W > V on R*^ x R n . If W is a subsolution of the Hamilton- J acobi equation 
( [i.4 ), in the sense that 

xR n , Vuefi n , D L W(t, x)(l,-u) < L + (x,u), 



(5.15) V(t,x)e 



then W < V on R% X K n . 

Therefore the restriction of V to R*. x l? n zs t/ie unique non negative locally 
Lipschitz function which satisfies the initial conditions (4-St) and (5. IS) and solves 
the Hamilton- J acobi equation \1.4Q in the sense of (5.11) and (5.1k). 

Proof — The fact that V is locally Lipschitz on R* + x R n is proved in Corollary 
3.4. Conditions ( f4.20| ) an d (^-13 ) for V follow from Proposition |3.1|. C ondition (5.11) 
is proved in Proposition |3.2| , while ( 5.12| ) follows from Theorem |5.1| . 

Let W be as in the statement of the theorem. If W is a supersolution, i.e., 
W satisfies (|1|), then we can prove that W > V, arguing as in the proof of 
Theorem |4.5| (with Theorem 4.1 replaced by Theorem 5.1). If W is a subsolution, 
i.e., W satisfies (|5.15|), then W < V by Theorem 5.1 and Remark 5.4. □ 
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